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Abstract 

Let p be a saddle fixed point for an orientation-preserving surface diffeomorphism 
/, admitting a homoclinic point p'. Let V be an open 2-cell bounded by a simple loop 
formed by two arcs joining p to p', lying respectively in the stable and unstable curves 
at p. It is shown that f\V has fixed point index p S {1,2} where p depends only on 
the geometry of V near p. More generally, for every n > 1, the union of the n-periodic 
orbits in 1/ is a block of fixed points for /" whose index is p. 


0 Introduction 

Poincare invented homoclinic orbits, conjectured their existence in the planar three body 
problem, and despaired of understanding their complexity. Research by Birkhoff, Cartwright 
& Littlewood, and Levinson revealed that near transverse homoclinic points there are ro¬ 
bust periodic points. A pinnacle of this line of research, and the basis for much of modern 
dynamical theory, is Smale’s “horseshoe” theorem m For a diffeomorphism / of a man¬ 
ifold of any dimension, it states that every neighborhood of a transverse homoclinic point 
meets a structurally stable, hyperbolic compact invariant set K on which some iterate 
is topologically conjugate to the shift map on the Cantor set 2^. 

Similar results have been obtained under weakenings of the transversality assumption, 
including work by Burns &: Weiss [S], Collins [S], Churchill &: Rod [7j, Gavrilov & Silnikov 
naini, Guckenheimer & Holmes m, Mischaikow CH!, Mischaikow Sz Mrozek m, New- 
house EOl, Rayskin HU. 

Among many important consequences is the existence of hyperbolic periodic orbits in K 
of all periods kn, n > 1. Note, however, that k is not specihed in the horseshoe theorem, and 
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in most cases there is no way to estimate it (but see Mischaikow & Mrozek [Hj). Collins 0 
has shown that a topologically transverse homoclinic point implies the existence of periodic 
points of all sufficiently high minimum periods; estimating such periods, however, requires 
detailed knowledge of the associated homoclinic tangle. 

While the horseshoe theorem guarantees infinitely many periodic orbits, it is insufficient 
for the existence of a second fixed point. For example, the toral diffeomorphism induced 
by the matrix has only one hxed point, even though transverse homoclinic points are 
dense. 

It turns out that for diffeomorphisms of the plane, even a nontransverse homoclinic 
point implies a second fixed point; in fact there is a block of fixed points having index +1. 
But the proof of this (Hirsch [HI), based on Brouwer’s Plane Translation Theorem, gives 
no indication of the location of such a block. 

In this paper we consider a saddle hxed point p for an orientation preserving homeomor- 
phism / of a surface X. Let p' be a homoclinic point associated to p, i.e., a point different 
from p wherethe stable and unstable curves IFs(p), Wu{p) meet; no transversality or even 
crossing of these curves is assumed. Suppose F = U is a homoclinic loop p, where Jg 
and Ju are arcs in Ws{p) and Wu{p) respectively, having common endpoints Assume 
there is a closed 2-cell, with interior V, whose boundary is the union of two arcs in Ws{p) 
and Wuip) respectively, having endpoints p and p' in common but otherwise disjoint; such 
a 2-cell always exists when X is simply connected. 

Our main result, stated more precisely in Theorem II.2L is this: 

If A is a Jordan curve bounding an open 2-cell V, there exists p G {1,2} sueh that the fixed 
point index of in V for all and p depends only on the geometry ofV. 

An immediate consequence is that for every n > 2, every map sufficiently close to /”■ has a 
block of hxed points in V of index p . 

Theorem o is a similar result for homoclinic loops that are homotopically trivial, but 
not necessarily Jordan curves. 

The main theorem is stated in Section^ and several applications are derived. Section 
m contains the proof of the main theorem. 

1 The main result and applications 

Z,N and N+ denote the integers, natural numbers and positive natural numbers. 

All maps are assumed continuous; ~ denotes homeomorphism. 

For any map g, the maps g'^,n > 1 are dehned recursively hy g^ = f and g'^^^{x) = 
g{g'^{x)) provided g'^{x) is in the domain of g. 

X always denotes a connected, oriented surface with metric d, and /: X —> S' is an 
orientation preserving injective map. We call / a diffeomorphism when / and f~^ are 
(continuously differentiable). 

The orbit of x is the set y{x) = {/*(x) : i G Z}. The hxed point set of / is denoted 
by Fix(/). We call q G Fix(()/) smooth if it belongs to a coordinate chart in which / is 
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represented by a map; such a chart is smooth for p. If / is of course all fixed points 
are smooth. But in many constructions some fixed points of a nonsmooth maps are smooth, 
as when a diffeomorphism of the plane is extended to the 2-sphere. 

Let q G Fix (/) be smooth. We call q simple if 1 is not an eigenvalue of the linear operator 
dfq, hyperbolic if no eigenvalue lies on the unit circle C C, a sink if eigenvalues are inside 
S\ a source if they are outside, and elliptic if the eigenvalues are on but different from 
1 . 

A fixed point p is a saddle if it is not in the boundary of S, and there is a chart at p in 
which / is locally represented as a linear map [q j and either /r > 1 > A > 0, making p a 
direct saddle, or/r<—1<A<0, defining a twisted saddle. Such a chart is diagonalizing. 
By the Hartman-Grobman linearization theorem (Hartman m), for p to be a saddle it is 
sufficient for there to be a smooth chart at p in which dfp has eigenvalues p, A as above. 

An n-periodic point for / means a fixed point z for /”, n > 1. When n is the minimum 
period, 7 (z) is an n-orbit. An n-periodic point is simple, hyperbolic, and so forth, when it 
has the corresponding property as a fixed point for /"■. 

The stable curve Ws = H4(p) of a saddle fixed point p is the connected component of 
p in the set of x for which there is a convergent sequence > p in X with xq = x and 
f{xk) = Xk+i. The unstable curve Wu at p is defined as the stable curve for f~^. Note that 
Ws and Wu are mapped homeomorphically onto themselves by /. Owing to the linearization 
assumption, there are bijective maps Cu,Cs ■ R —^ Wg taking 0 to p, called parametrizations 
of Wu, Wg respectively. The images of [0, oo) and (—oo, 0] are the four branches at p. 

A homoclinic point for p is any point p' G Wg fl Wu \ {p}, in which case the homoclinic 
loop A defined by p' is the closed path formed by the two arcs Jg C Wg, Ju C Wu having 
common endpoints p and p'. There corresponds an element [A] of the fundamental group 
of X at p, determined by first traversing A from p to p' in Ju and then from p' to p in Jg. If 
[A] is the unit element, A is a inessential homoclinic loop. A is simple if H = {p,p'}, in 
which case A is homeomorphic to the unit circle. Every homoclinic loop contains a simple 
homoclinic loop. 

Suppose A is a simple homoclinic loop in X bounding a closed 2-cell D C X. The 
corresponding open 2-cell V = D \ dD is a homoclinic cell. We call H is a positive cell 
provided some diagonalizing chart takes p to the origin 0 G and a neighborhood of p 
in D onto a neighborhood of 0 in the first quadrant. In the contrary case D is a negative 
cell: there is a diagonalizing chart taking a neighborhood of p in T) onto a neighborhood 
of the origin in the complement of the open first quadrant (see Figure 1). Thus when seen 
through a diagonalizing chart, a positive cell appears convex near p, while a negative region 
appears concave. 

Let f7 C X be an open set such that U n Fix (/) is compact. The fixed point index of 
f in U is denoted by I{f,U) G Z; if it is nonzero, there exists a fixed point in U (Bold 
IH]). When [/ is a coordinate chart identified with an open set in R^, we can calculate 
/(/, U) as follows. Let M C 1/ be a compact surface with boundary whose interior contains 
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(a) 


(b) 


Figure 1; Homoclinic cells: (a) positive (b) negative 


Fix (/) n U. Then /(/, U) is the degree of the map 


dM S\ 


X - f{x) 
X- f{x)\\’ 


where dM and inherit their orientations from R^. If dM is replaced by any oriented 
Jordan curve F on which / has no fixed points, the same formula defines the index of f 
along F. 

Let B C X he a block of fixed points, i.e., B is compact and relatively open in Fix(/). 
There exists an open neighborhood Uq (Z X such that B = Fix (/) n Uq. The number 


lnd(/,R) = lnd(/|C/o)GZ, 


called the index of f at B, is independent of the choice of Uq. When p is an isolated fixed 
point we set Ind /, {p}) = I{f,p), called the index of f at p. A direct saddle has index —1. 
Twisted saddles, sources, sinks and elliptic fixed points have index +1. 

The following assumptions are in force throughout the rest of this article; 

Hypothesis 1.1 


• /: X X is an orientation-preserving homeomorphism of a surface X. 

• p G X \ dX is a direct saddle fixed point for f. 

• V C X is an open 2-cell bounded by a simple homoclinic loop A at p. 
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To V we assign the number 


1 if y is a positive region 

2 if y is a negative region. 


p = p(v) = I 

For each n G N+ we define an open set Vn C V, 

Vn = Vn{f) = {xeV: fix) ev, i = l,...,n-l} 

Thus Fix iff n is the union of the n-periodic orbits in V. 

The following is our fundamental result: 

Theorem 1.2 Fix (/"■) DVn is a block of fixed points for f"' of index pfV), for all n > 1. 

Before giving the proof of Theorem 11.21 in Section [2 we present several consequences. 
Hypothesis 11.11 is always assumed. 

Homeomorphisms of the sphere 

Assume g: ~ 5^ is an orientation preserving homeomorphism having a simple homoclinic 

loop A at a direct saddle. 

Theorem 1.3 The fixed point index of g in one of the two complementary components of 
A is 1, and the index in the other is 2. 

Proof This follows from Theorem o because one complementary component of A has 
positive type and the other has negative type. | 

The persistence of blocks having nonzero index implies: 

Corollary 1.4 Every map 5^ —> 5^ suffieiently close to g has at least 3 fixed points. 

A homoclinic loop constrains fixed point indices. Suppose for example that there are 
exactly 3 fixed points: a direct saddle and two other fixed points with respective indices 5 
and -2. Then the saddle does not admit a homoclinic point. 

Inessential homoclinic loops and Nielsen classes 

Fixed points a, b are in the same Nielsen elass provided they are endpoints of a path that 
is homotopic to its composition with /, keeping endpoints fixed. Equivalently, / is covered 
by a map in a universal covering space having fixed points over a and b. 

When X is compact, every Nielsen class is a block of fixed points, and the Nielsen number 
of / is the number of Nielsen classes having nonzero index. This number, a homotopy 
invariant of /, is a lower bound for the number of fixed points for any map homotopic to /. 
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Theorem 1.5 Assume p belongs to an inessential homoclinic loop. Then its Nielsen class 
contains a block of positive index, and such a block must contain a fixed point qfip. When 
the Nielsen class of p is finite, q can be chosen with positive index. 

Thus in the presence of a inessential homoclinic loop, the number of fixed points exceeds 
the Nielsen number. Theorem II. 101 is a similar result for Lefschetz numbers. 

Corollary 1.6 If a direct saddle p is the only member of its Nielsen class, then p does not 
belong to an inessential homoclinic loop. 

In proving Theorem ll.bi we assume X is not simply connected, otherwise using Theorem 
o As X is orientable, there is a universal covering space tt : —> X. Choose p € tt ^{p), 
and let /: —> R^ be the unique lift of / with a fixed point at p. Then p is a direct 

saddle for /. 

Let r be a null homotopic homoclinic loop at p. There is a unique homoclinic loop 
r C R^ for / that contains p and projects onto T under vr. Let A C T be a simple 
homoclinic loop at p. There is a unique an open 2-cell V C R^ bounded by A, and C is a 
closed 2-cell. Applying Theorem 11.21 we choose a block L C Fix(/) n V such that 

lnd(/,L) = cr G {1,2} 

Notice that 7r(L) lies in the Nielsen class of p. 

Every fixed point z G tt~^{p) has index —1, since / in a neighborhood of is conjugate 
to / in a neighborhood of 7r{z). Because V is compact, vr“^(p) n E is finite. Therefore 
L \ vr“^(p) is nonempty, for otherwise L would be a nonempty finite subset of and 

thus have negative index. 

It follows that 7r(L\7r“^(p)) is a nonempty subset of Fix (/) disjoint from p, contained in 
the Nielsen class of p. Suppose this class is hnite. Then L\7r~^{p)) is hnite. Let LmT~^[p) 
have cardinality n, 1 < n < oo. Then 

lnd(/, L \ 7r"^(p))) = lnd(/, L) - lnd(/, L n (vr"^(p))) 

= lnd(/,L) - 1 / lnd(/,p)) 

= a + v > 2 

Therefore exists q ^ L \ '/r“^(p) with 0 < lnd(/, q) = lnd(/, vr(g)), and 7r(g) is in the Nielsen 
class of p. This completes the proof of Theorem 11.51 

Periodic orbits in a homoclinic cell 

The following theorem can be used to demonstrate the existence of inhnitely many periodic 
orbits in situtations where the horseshoe theorem may not apply: 

Theorem 1.7 Let r G N 6e such that every 2^-orbit, 0 < k < r in the homoclinic cell V is 
hyperbolic. Then either: 


6 



(a) V contains an attracting or repelling 2^-orbit for some /c G {0,..., r}, 
or else 

(b) V contains a twisted saddle orbit of cardinality 2^ for every k = 0,... ,r. 

Proof Suppose (a) does not hold. Fix n = 2^, 0 < k < r and let B C Fix {f\Vn) be a block 
having index p G {1,2} fTheorem 11.21) . Then some q & B has index 1 for /”. Since (a) is 
ruled out, q is not a source or sink for /"■. The only other possibility for a hyperbolic, index 
1 fixed point for /"■ is a twisted saddle. This implies n is the minimal period for q. Thus 
(b) holds. I 

Corollary 1.8 Assume every periodic orbit in V whose cardinality is a power of 2 is a 
saddle. Then V contains a twisted saddle orbit of cardinality 2^ for every A: G N. 

Corollary 1.9 If f is and 0 < Det dfx < 1 in a dense subset ofV and all periodic points 
in V are hyperbolic, then V contains either a periodic attractor, or an orbit of cardinality 
2^ for every A; G N 

It is interesting to compare these results to a theorem of Franks cni. Specialized to an 
orientation-preserving diffeomorphism of the 2-sphere, it states: 

If all periodic points are hyperbolic, and at most one orbit whose cardinality is 
a power of 2 is repelling or attracting, then there are infinitely many periodic 
orbits. 

Corollary 11.81 makes no assumptions on orbits outside the homoclinic cell V, but does not 
allow any attractors or repellors of cardinality 2^ in V. It gives sharper information than 
the conclusion Franks’ theorem on the periods and locations of periodic orbits. 

It is not trivial to construct diffeomorphisms of the disk or sphere, all of whose periodic 
orbits are saddles; but examples are known that even have the Kupka-Smale property, i.e., 
stable and unstable curves of periodic points have only transverse intersections (Bowen & 
Franks |31 , Franks & Young mi)- Gambaudo et. al m construct real analytic Kupka-Smale 
examples on the disk. 

Lefschetz numbers 

Let the cardinality of a set Q. 

Suppose Y is a compact surface and h : X —f X is continuous. The Lefschetz number 
Lef(/i) is the alternating sum of the traces of the induced endomorphisms of the singular 
homology groups Hi{X), i = 0,1,2; it equals lnd(/i, Y). Lefschetz proved that when the 
fixed point set is finite, Lef(/i) is the sum of the fixed point indices. When every fixed point 
has index -|-1, —1 or 0 this gives the useful estimate 

#Fix(h)>|Lef(h)| 

The following results show that when fixed points are simple, homoclinic cells entail the 
existence of more fixed points than are counted by the Lefschetz number. 
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Theorem 1.10 Assume X is a compact surface, Fix (/) is finite, and every fixed point has 
index +1, —1 or 0. If f admits a homoclinic cell, then 

#Fix(/) > \lefif) +l-p\ + l + p > |Lef(/)| + 2 


Proof For any open set A <Z X, summing indices over fixed points z £ A gives: 


lnd(/, A)\ 




Z 


<#(Fix(/)n^) 


Applying this to a homoclinic cell V, from Theorem 11.21 we get 


# (Fix (/) n P) = 1 + # (Fix (/) n F) > 1 + I lnd(/, F)| 
= l + p 


because lnd(/, F) = p. Also 

#(Fix(/)n(X\F))>|lnd(/,X\F)| 

= Ilnd(/,X)-(lnd(/,p) + lnd(/,F))| 

= |Lef(/) + 1 - p| 


because lnd(/, p) = —1. Therefore 

if Fix (/) = # (Fix (/) n F) + # (Fix (/) n (A \ F)) 
>{'^ + p) + !Lef(/) + 1 - p| 

>|Lef(/)| + 2 


Corollary 1.11 Assume X is a compact surface, Fix(/) is finite, and every fixed point has 
index +1, —1 or 0. If iff\x{f) < |Lef(/)| + 1, there are no homoclinic cells. 

2 Fixed point indices and retractions 

This section contains the proofs of Theorems II .21 and II .51 Hypothesis 11.11 continues to hold. 
Let D G X denote the closure of the homoclinic cell F. Then H is a compact 2-cell whose 
boundary is the simple homoclinic loop A. 

A retraction of a space Y onto a subset Yq C F is a map Y ^ Yq hxing every point in 

Fo. 

Lemma 2.1 Assume we are given n G N+ and a map g: D ^ D with the following 
properties: 
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(i) g coincides with f'^ on a neighborhood of p in D 

(ii) Fix {g) = K U {p} where K dV is eompaet. 
Then \nd{g,K) = p{V) 


Proof 

map 


Fix a coordinate chart in which p is the origin and is represented by a linear 
T{x, y) = (Ax, py), \ <l < p 


We identify points near p with their images in under this chart. 

Consider the case that F is a positive homoclinic cell {p = 1). Then there is a compact 
disk neighborhood N C centered at the origin, meeting D only in one of the four closed 
quadrants; to fix ideas, we assume it is the first quadrant Qi. We take N so small that g 
coincides with Tm.NdD,NdK = 0, and U D is a 2-cell. 

Choose a retraction s : ^ n Qj. We compute the fixed point index lnd(r o s, N). 
Let e > 0 be so small that the disk of radius e lies in N. Let Sl denote the circle 

bounding D^. Since T o s has the unique fixed point 0, the index equals the degree of the 
map 


u : S: 


S\ 


z-T o s{z) 
z — T o 5 ( 2 ) 1 1 


The retraction s sends any point z G N \ Qi to the unique point s{z) G dQi such that 2 
and 5 ( 2 ) are the endpoints of a line segment having slope 1; and s is the identity on NnQj. 
A simple computation shows that u takes no values in the first quadrant of the unit circle, 
and thus has degree zero. Thus lnd(T o s, N) = 0. 

Now consider the map h'.NUD^DcNUD defined to be T o s in A^ and g in D] this 
definition is consistent because s is a retraction and g coincides with T in A^ n D. Clearly 


Fix (h) = {p}UK C Int(Ar U D) 

Therefore 

Lef(/i) = lnd(h, Int(A^ U D)) = lnd(/i,p) -F lnd(/i, K) 

Note that Lef(/i-) = 1 because A^ U D is a compact 2-cell, and lnd(/i,p) = lnd(T o s,N) = 0. 
Hence 

1 = lnd(/i, iL) = lnd((/, AT) 

as required. 

When F is a negative homoclinic cell, we can assume N DD exeludes the interior of the 
first quadrant. The retraction s : N N \ Int Qj is defined by sending z G N CiQi to the 
unique point of dQj such that 2 and r{z) are the endpoints of line segment having slope 1; 
and r is the identity on A^ \ Qj. The degree of T o r in this case is —1. Define h as above. 
An argument similar to the preceding shows that 

1 = lnd(/i,Int(Ar U D)) = lnd(/i, {p}) -F lnd(/i, Int(A^ U D)) 

= —1 -F lnd( 5 r, Int(A' U D)) 
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Let Ju C Wu{p) and Js C Ws{p) denote the two compact arcs whose union is A; these 
arcs meet at their common endpoints, which are p and the homoclinic point p' ^ p, but 
nowhere else. 

Our next goal is the following result: 


Proposition 2.2 There is a retraction 

r : f{D)UD-> D 

such that 

r{f{D)\D)cJs 


( 1 ) 


Proof We first prove 


or equivalently, 


Ju n clos(/(D) \D) = {p,p'} 


Ju n clos(/(F) \D) = {p,p} 
Suppose m is false, so that there exists 

be Ju\ {p, p'} n clos(/(P) \ D) 


(2) 


Then b = limj^oo fi^i) for some sequence Oj G V\f~^D, and b = f{a) by continuity. I claim 
/ maps a relatively open neighborhood Na <Z D oi a onto a relatively open neighborhood 
fi^a)) C f{D) of /(o). This is because / maps the interior of D onto the interior of 
f{D). The assumption that p is a direct saddle implies / preserves orientation, and f~^\Ju 
preserves orientation in Ju- From this it follows that Na and f{Na) abut Ju from the 
same side. Consequently f{Na) contains a relatively open neighborhood N^, d D oi b. For 
sufficiently large i we have ai € f~^Nh and thus ai G f~^D. This contradiction completes 
the proof of 0 . 

From Equation 0 we see that 


clos(/(T>) \D)r\ DcJs 


( 3 ) 


Note also 

f{D)UD = clos{fiD)\D)UD, 
clos(/(T>) \D)nD =clos(/(T>) \D)ndDcJs 

By Tietze’s extension theorem there is a retraction 

ro : clos(/(D) \ T») U ^ 

and ro agrees with the identity map of D on the intersection of their domains, which by 0 
is Js- Thus ro and the identity map of D fit together to give the desired retraction r. | 
From now on r : f{D) U D ^ D denotes a retraction as in Proposition 12.21 


10 


Lemma 2.3 Let n € N. For every q G Fix(/”) fl Vn there is a neighborhood U G Vn of q 
such that f'^\U = (r o /)"'|C/. 

Proof The definition of Vn implies f^{q) & Vn C V for all j G N. Therefore q has a 
neighborhood U such that p{U) C Vn for i = 0,..., n. Assume inductively that 0 < i < n 
and P\U = (r o /)*|[/; the case f = 0 is trivial. For x G 17 we have (r o /)*(x) = /*(x), and 
both /*(x) and /*“'"^(x) are in V because x € Vn- Hence 

(r o /)*+^(x) = (r o f)ifix)) = r(/*+^(x)) = 

because r and / coincide on H. This completes the induction. | 

Lemma 2.4 Fix ((r o f\D)'^) = {p} U (Fix (/”■) fl 17i) for all n > 1. 

Proof Let x G D \ {p} be n-periodic for r o f. We first show x ^ Jg- We know that 
Js is invariant under /, and r|is the identity because Jg C D. Thus r o f\Jg coincides 
with f\Js, whose only periodic point is p. The foregoing implies no point on the orbit x 
under r o f lies in Jg. Therefore no point y in this orbit maps outside D under /, for 
otherwise (r o f){y) G Jg by Equation (^. This proves 7 (x) C D, and an induction that 
(r o f)^x = f^x for all k. Since Ju\p is contains no periodic points for /, the conclusion 
follows. I 

Proof of Theorem 11.21 

The set B = Fix (/"■) D Vn is open in Fix (/"■) because Vn is open. We prove B compact by 
showing it is closed in D. Since B n dD C {p}, it suffices to prove that p is not a limit point 
of B. Clearly p ^ B, and p, being a saddle, has a neighborhood in which the only point of 
period n is p. Therefore H is a block. 

To prove lnd(/"',H) = p, let r : f{D) U D —> 71 be a retraction as in Proposition 1221 
Lemmas 12.41 and lOl show that lnd(/”,73) = lnd((r o/|17)”, 73). Now apply Lemma 12.l| to 
g '■= {r o f\D)^ to conclude that lnd((r o f\V)^, B) = p. | 
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